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Pr«Tlou*ly  ve  hare  •hovn  that  ^ba  fundasantal  problaa  of 

datamlnlnc  tb»  utility  of  a  eiawiuil  cation  channal  in  ooBTaylac 
# 

inforBatioB  vlavad  aa  a  problaa  vlthln  tba  f 

ata^  deeiaioo  proeaaaaa  of  atoehaatlo  typa,  and  aa  a\ieb  aaiaitat  traatad 
by  tha  thaory  of  dynaaie  proftra—l  ItaniiHaBavr  tba  ralatloao  batwaan 

utility  and  eai>acity,  in  .Shannon 'a  aanaa,  haannB  indleatad. 
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ork  of  Hulti- 
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FuUaali^'^  iJilaf  laaH 
eoHBunleatlon  problaaa  inrolvlng  tha  uaa  of  a  ehannal  vhoaa  propartlaa 
are  not  ea^letaly  knoh-n,  and  thoaa  inrolvlng  prooaaaaa  of  randca 


Xr^t^tnf  J 


uju  ihe.v»'.  • 

duration^  /\ 
praffimm  thaory. 


hra*  ganaral  prooaaaaa 


iu  a  unifora  faahion  by  tha  functional  equation  taehnlqua  of  dynaaie 
pro^raMing/^  ^ 
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01  CdtCUHICATIOH  PICCI33ES  IHVOLVIIW 
IXARflUO  AXL  IU5ZXM  DUIUTIOH 

by 

Richard  Bellaan  aad  Robert  Kalaba 

In  two  earlier  paper*,  |^2j  ,  ^  >  v*  have  shovn  how  cevaral  geiMral 

cla«M*  of  rtoohaatle  iir—nni  oat  Ion  probleu  my  be  vlcved  a*  aulti-atage 
declelon  prooe**e*  of  rtochaetio  type,  |l]  .  Our  purpoee  here  1*  to 
ortead  the*e  eomlderetloii*  to  Bore  gemral  aiul  reallatie  arm  mil  oat  1  op 
■Ituatlona  Inrolvlof  (1)  channel*  vho**  propei^ie*  ar*  only  partially 
kxwvn;  (2)  mmninl cation  |  roc*****  of  rtLodoa  length;  (')  allocation  of 
eifXkad  detection  equipawnt. 

Our  dlscuaaioD  revolve*  around  the  deterMlnation  of  the  'utility' 
of  a  oomnmieatioQ  channel,  where,  naturally,  the  utility  depend*  upon 
the  UM  to  which  the  channel  ia  to  be  put.  We  conceive  of  a  three-eloBent 
ooHnmication  syeteai  coceieting  of  a  aouroe  of  aignala,  a  comuni cat  1  on 
ohaiuiel,  and  an  obaerver,  and  aaame  that  the  obaervar  uaaa  the  received 
algnals  (in  an  optlnal  faahion)  to  aid  in  achieving  aoa»  objective,  in 
the  oourae  of  a  eulti-atage  proceaa.  The  utility  of  the  channel  can 
then  be  maaured  by  oaaq>arlng  the  obaerver' a  perfomanoa  against  tha 
parformnea  of  a  hypothetical  reference  obaerver  provldad  with  an  error- 
free  channel,  or  agaiixat  one  provided  with  no  channel  at  all. 

Tha  aituation*  covered  are  quite  broad  in  acope.  Not  only  do  our 
con* ide rati ona  apply  to  atrlctly  teehnologloal  ooMBunl cation  problem, 
but  alao  to  ganaral  problem  of  expei’lmntal  physic*,  in  which  nature 
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is  the  source,  the  erperlBcoters  the  chsuuMl,  sud  the  scientific 
corps  is  the  obseinrer.  Also  dsserlbable  In  this  vay  are  problems  of 
forecasting  (veather  or  eoonosilc  oondltlocis) ,  etc. 

We  have  shovn  previously  how  a  variety  of  probleas  arising  frtsi 
this  general  frosMvork  can  be  foraulated  as  probleas  Involving  functional 
equations  of  a  novel  type  which  can  be  solved  analytl ealJLy  in  soae  oases 
and  In  oUitr  cases  by  ths  use  of  casq>utlng  aaehlnes .  In  particular, 
generalltli^  and  extending  results  of  Kelly,  ,  ve  have  Indleeted 
the  connection  between  channel  utility  ax^  channel  capacity  in  ths 
sense  of  Shannon. 

In  the  present  work,  ve  consider  the  Important  case  In  which  the 
channel  has  fixed,  but  not  ccopletely  known,  characteristics.  In  the 
course  of  the  process,  the  observer  not  only  aakes  decisions  on  ths 
basis  of  knowledge  possessed,  in  an  effort  to  attain  his  gool,  but  also 
atteapts  to  deduce  t^te  characteristics  of  the  systea  frea  the  events 
that  hare  occurred  ( f:*es  Robbins  ,  ,  for  an  interesting  expoeltlon  of  learning 

procesBCB).  Depending  on  hcM  the  term  not  completely  known'  Is 
interpreted,  ve  obtain  a  hierarchy  of  processes  which  can  be  treated 
by  the  functional  equation  technique  oi  oynaitic  prograailng. 

Next  ve  consider  processes,  which  in  addltloo  to  possessing  ths 
previous  features  possess  the  oo^lication  of  having  randoa  duration. 

Various  radar  detection  processes  are  of  this  type. 

The  foregoing  probleas  are  in  turn  special  oases  of  still  aors 
gensml  probleas  arising  in  prediction  theory.  Here  ve  encounter  the 
additional  difficulties  of  utillxlng  various  types  of  channels,  with 
different  reliability  charucteiistloe  and  different  coats.  Finally, 
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ext«nj>loixi3  of  these  prooessei  lead  to  proM ans  Involving  United  storage 
of  infonaatloc,  and  delays  In  both  processing  inforaatlon  and  evaluating 
the  results  of  previous  decisions. 

Our  sin  thro\jghout  Is  to  Illustrate  hov  quite  general  prooesses 
of  the  types  described  above  can  be  t?-eated  In  a  unlfore  fashion  by 
■esns  of  the  theory  of  dynaelc  programing. 
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